Infrastructural haptics on wall scale interactive displays

ABSTRACT

An interactive wall provides tactile feedback based on detected touch and displayed content on the wall surface. Upon detecting a touch on the wall surface, the interactive wall provides real time tactile feedback corresponding to the touch employing one or more actuators. The interactive wall itself may serve as projection surface for the display or a wall-size display be affixed to the wall trans-conducting tactile feedback to the user.

BACKGROUND

Touch sensitive display technologies are ever prevalent in moderndevices. A variety of devices ranging from hand held mobile devices tolarge LCD displays incorporate touch sensitive layers to enable the userto interact with displayed content directly. Touch sensory integrationin displays eliminate the need for additional devices to control thedisplayed content. In addition, touch sensory input may enable aheightened level of user interaction with displayed content by enablingadditional levels of control such as multi-gesture input, two handedinput, multiple user input, etc.

A majority of legacy touch sensitive displays do not provide tactilefeedback. Lacking a feedback, a user is unable to sense an interactionwith the displayed content. Those devices with tactile feedbackcapabilities usually implement such features in limited fashion. Deviceswith tactile feedback functions are usually limited to small displaysizes and mostly implement vibration based technologies. Limiteddeployment of tactile feedback technologies take away from a moreimmersive user experience while interacting with displayed content.

SUMMARY

This summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This summary is not intended to exclusively identify keyfeatures or essential features of the claimed subject matter, nor is itintended as an aid in determining the scope of the claimed subjectmatter.

Embodiments are directed to providing infrastructural haptics on wallscale interactive displays. An interactive wall may be enabled to detecta touch on a wall surface through sensors of the interactive display.Upon detecting a touch event such as a click, a button press, a draggingmotion, or comparable action, the interactive wall may provide a tactilefeedback corresponding to the detected touch through actuatorsintegrated into the wall.

These and other features and advantages will be apparent from a readingof the following detailed description and a review of the associateddrawings. It is to be understood that both the foregoing generaldescription and the following detailed description are explanatory anddo not restrict aspects as claimed.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram illustrating example components of a systemproviding infrastructural haptics on wall scale interactive displays;

FIG. 2 illustrates an example action diagram of providinginfrastructural haptics on wall scale interactive displays;

FIG. 3 illustrates a top view of the structure an example interactivewall providing infrastructural haptics for wall scale interactivedisplays according to some embodiments;

FIG. 4 displays a frontal view of the structure an example interactivewall pro riding infrastructural haptics for wall scale interactivedisplays according to some embodiments;

FIG. 5 is a networked environment, where a system according toembodiments may be implemented;

FIG. 6 is a block diagram of an example computing operating environment,where embodiments may be implemented; and

FIG. 7 illustrates a logic flow diagram for a process of providinginfrastructural haptics on wall scale interactive displays according toembodiments.

DETAILED DESCRIPTION

As briefly described above, infrastructural haptics may he provided onwall scale interactive displays. An interactive wall may be enabled todetect a touch on a wall surface through sensors of the interactivewall. Upon detecting the touch, the interactive wall may provide realtime tactile feedback corresponding to the detected touch. In thefollowing detailed description, references are made to the accompanyingdrawings that form a part hereof, and in which are shown by way ofillustrations specific embodiments or examples. These aspects may becombined, other aspects may be utilized, and structural changes may bemade without departing from the spirit or scope of the presentdisclosure. The following detailed description is therefore not to betaken in a limiting sense, and the scope of the present invention isdefined by the appended claims and their equivalents.

While the embodiments will be described in the general context ofprogram modules that execute in conjunction with an application programthat runs on an operating system on a computing device, those skilled inthe art will recognize that aspects may also be implemented incombination with other program modules.

Generally, program modules include routines, programs, components, datastructures, and other types of structures that perform particular tasksor implement particular abstract data types. Moreover, those skilled inthe art will appreciate that embodiments may be practiced with othercomputer system configurations, including hand-held devices,multiprocessor systems, microprocessor-based or programmable consumerelectronics, minicomputers, mainframe computers, and comparablecomputing devices. Embodiments may also he practiced in distributedcomputing environments where tasks are performed by remote processingdevices that are linked through a communications network. In adistributed computing environment, program modules may be located inboth local and remote memory storage devices.

Embodiments may be implemented as a computer-implemented process(method), a computing system, or as an article of manufacture, such as acomputer program product or computer readable media. The computerprogram product may be a computer storage medium readable by a computersystem and encoding a computer program that comprises instructions forcausing a computer or computing system to perform example process(es).The computer-readable storage medium is a non-transition comparerreadable memory device. The computer-readable storage medium can forexample be implemented via one or more of a volatile computer memory, anon-volatile memory, a hard drive, a flash drive, a floppy disk, or acompact disk, and comparable physical storage media,

Throughout this specification, the term “platform” may be a combinationof software and hardware components for providing infrastructuralhaptics on wall scale interactive displays. Examples of platformsinclude, but are not limited to, a hosted service executed over aplurality of servers, an application executed on a single server, andcomparable systems. The term “server” generally refers to a computingdevice executing one or more software programs typically in a networkedenvironment. However, a server may also be implemented as a virtualserve software programs) executed on one or more computing devicesviewed as a server on the network. More detail on these technologies andexample operations is provided below.

Haptics is a technology to provide tactile user feedback to touch.Sensors on a surface may detect the touch by sensing pressure.Alternatively, optical or infrared detection based sensor technologiesmay also be implemented. A control device may receive the sensor inputand instruct actuators to move the surface. The surface movement may bedependent on the location and the sequence of the touch. The actuatorsmay move part of the surface. Alternatively, actuators may move thewhole surface based on the control service's instructions.

Embodiments are not limited to haptics as described above. A surfacewith haptics capabilities may be utilized for display purposes. Thetactile feedback may be shaped according to displayed content. Anexample may be a simulation of a scroll wheel. A haptics capable surfacemay provide the sensation of a clickable scroll wheel as a user swipesalong the surface. The haptics capable surface may utilize vibratingactuators to move the surface. Alternatively, the haptics capablesurface may utilize sound producing actuators to move the surface fortactile feedback while providing audio feedback.

Embodiments provide infrastructural haptics on wall scale interactivedisplays. Tactile feedback may enable walls to act as interactive mediawhile serving as displays. A user may be enabled to touch an interactivewall and receive feedback from the interactive wall displaying aprojected image. Alternatively, an interactive wall may provide tactilefeedback to a user utilizing a display attached to the wall. Whilereferences are made to interactive walls providing tactile feedbackthrough sensors and actual throughout the Specification and Claims,embodiments are not limited to only vibration as a means to move theinteractive wall. Tactile feedback through an interactive wall may beprovided through other means applying the principles discussed herein.

FIG. 1 is a diagram illustrating example components of a systemproviding infrastructural haptics on wall scale interactive displays. Indiagram 100, the server 110 may provide control services such asmanagement of tactile feedbacks based on detected touch on aninteractive wall. In an example scenario, a user or multiple users maybe interacting with a display attached to or projected on an interactivewall 130. The interactive wall 130 may detect a user's touch through itssensors (e.g., pressure sensors). The interactive wall 130 may reportthe detected touch to the control service 110. The control service 110may search and retrieve a corresponding tactile feedback to the touchfrom a data store containing sensory inputs and matching tactilefeedbacks. The control service 110 may transmit the retrieved tactilefeedback corresponding to the detected touch to the interactive wall130. The interactive wall 130 may play the tactile feedback through itsactuators (e.g., simulating a scroll wheel where the scroll bar isdisplayed).

Embodiments enable infrastructural haptics on wall scale interactivedisplays through control re Bourges using a network 120. The nets work120 may be a local net pork or may be an external entity such as anInternet based infrastructure. It may provide wired or wirelessconnectivity. Interactive wall 130 and the control service 110 mayconnect to each other through unsecured or secured connectivity. Anexample of a secured connectivity may be a Virtual Private Network (VPN)established among the interactive wall and the control service with theuse of encrypted communications.

The server 110 may provide tactile feedback matching a detected touch onthe interactive wall 130. The server may integrate sensory input withthe displayed content to retrieve matching tactile feedback. In anembodiment, the server 110 may provide the control service as a separateentity accessible through network 120. In an alternative embodiment, thecontrol service 110 may be provided by an integrated circuit within theinteractive wall. Yet in other embodiments, the control service may beon the display device for tight integration with the displayed content.Embodiments are not limited to client/server and peer-to-peerarchitectures. Providing infrastructural haptics on wall scaleinteractive displays may be accomplished using other architectures.

FIG. 2 illustrates an example action diagram of providinginfrastructural haptics on wall scale interactive displays. Insertion ofactuators into an interactive touch enabled wall surface (e.g., aninteractive projection surface including a projector and touch sensorsor a thin wall sized display) may be used to provide touch feedback tothe user. When a key event including, but not limited to, clicks, buttonpresses, dragging objects, etc. occurs, the actuator may provideimmediate physical response to the user giving them a deeper levelinteraction with a physical/mechanical object.

Embodiments introduce a user interaction model that provides a realistictactile sensation of manipulating physical objects, environments andcontrols. On-screen button shapes and topology may be felt through touchwithout having to rely on visual occures. The tactile, incrementalindents of an on-screen scroll wheel can be simulated, providing moreuser control. Textures can be simulated for swipe and multi-touchgestures. On-screen buttons may provide a click-back sensation whenpressed insuring a positive actuation. Navigation through virtualenvironments can be controlled using various levels of pressure on thescreen.

In a networked implementation, interactive wall 210 may detect touch,provide tactile feedback by forwarding the detected touch to controlserver 230, and receive instructions for providing tactile feedbackthrough actuators. The control server 230 may manage sensory feedbackand display con c it integration and transmit a corresponding tactilefeedback in order for the interactive wall to play the tactile feedback.

The interactive wall 210 may initiate real time tactile feedback tosensed touch by detecting a touch on wall surface through sensorsembedded within the wall (212). Alternatively, the touch may be detectedthrough optical sensors, infrared detection based sensors, or similarones. The touch may be a single instance of detected pressure on theinteractive wall surface. Alternatively, the touch may be sequence ofpressures in a varies of locations detected on the interactive wallsurface. After detecting the touch, the interactive wall 210 may requesta tactile feedback corresponding to the touch (214) from the controlserver 230. The request may include the location(s) the sequence, andthe level of pressure of the touch.

Next, the control server 230 may determine the tactile feedbackcorresponding to the touch (216). The control server 230 may analyze theparameters of the touch such as location, sequence, and level ofpressure and integrate with displayed content. In an example, if therequest matches single pressure in a sensory area corresponding to adisplayed button, the control server may search for tactile feedback fora button press. The control server 230 may retrieve a tactile feedbackmatching the touch from a data store containing variety of touches andtactile feedbacks corresponding to the touches.

Upon retrieving a corresponding tactile feedback, the control server 230may transmit the tactile feedback to the interactive wall (218). Theinteractive wall 210 may play the tactile feedback through actuatorsinstalled on the wall (220). The actuators may vibrate to move theinteractive wall in order to simulate a tactile feedback. An example maybe a swipe motion in which the actuators move the interactive wall tocreate contours along the length of the swipe to simulate a fluid wall.Alternatively the actuators may move the wall continuously to maintainsurfaces to duplicate the displayed content therefore giving a 3D shapeo the interactive wall surface.

Additionally, it is important to manage any delays in the tactilefeedback system. The tactile feedback may be played in real time withina time frame under a user's perception to detect delay. An example timeframe may be under 0.1 seconds from detection of the touch to the playof the tactile feedback.

The described infrastructural haptics on wall scale interactive displaysare for illustration purposes. Other tactile feedback systems oninteractive walls may be used to provide tactile feedback to detectedtouch. Furthermore, feedback may be simulated by actuators moving theinteractive wall through vibration, sound, etc.

FIG. 3 illustrates an example providing infrastructural haptics on wallscale interactive displays according to some embodiments. Diagram 300displays an example top down view of an interactive wall. In anembodiment, an interactive wall section 320 may be adjoined by standardwall sections 310, and 332. Each standard wall section may have a spacerbetween the wall stud and the standard wail surface 312 to dampen anymovement coming from an actuator from the interactive wall section.

In another embodiment, an air gap or dampening material between wallstud and the interactive wall may allow movement in between fixedsurfaces 322. Sensors 324 embedded within the interactive wall sectionmay detect touch from user(s). An actuator 330 may play a tactilefeedback corresponding to the touch to simulate hardware feedback. Theactuator 330 may be mounted on an actuator mounting bar 328.Additionally, the mounting bar may he fixed to an interactive wall stud326.

According to one embodiment, the sensors are embedded on the interactivewall surface registering the touch in another embodiment, a display isprojected to the interactive wall through a projector. Alternatively,the display may be overlaid on the interactive wall and utilize thedisplay's sensors to provide sensory input to the interactive wall. Thetactile feedback may be determined depending on a pressure level, alocation, and a sequence of the touch.

The scenarios discussed above are provided as example embodiments. Otherscenarios may he used to provide infrastructural haptics on wall scaleinteractive displays utilizing the principles discussed herein.

FIG. 4 displays another example providing infrastructural haptics onwall scale interactive displays. An example interactive wall may providetactile feedback corresponding to a touch according to displayedcontent. In an embodiment, the tactile feedback may be played in realtime to avoid delay in feedback response.

In some embodiments, diagram 400 may illustrate actuators installed asan array of actuators on an interactive wall 420 to provide tactilefeedback play through apart or whole of the interactive wall. Theinteractive wall 420 may be adjacent to a standard wall 410. Theinteractive wall 420 may have studs that have fixed bars 426 holding theactuator 424. In an example, the actuators may be vibration generatingdevices installed on bars spanning across interactive wall studs.

In another embodiment, the actuators may be installed equidistance aparton a grid behind the interactive wall. In yet another embodiment, theactuators may be installed on studs of the interactive wall. In anexample scenario, a damping agent or an air gap separates the actuatorsand the interactive wall to avoid vibration on the interactive wallstuds while moving the interactive wall. In another example scenario,dampening agents separate the interactive wall with adjacentnon-interactive walls.

In an example, the complexity of the tactile feedback may be dependenton a number of the actuators correlating a larger number of theactuators to a capability for an increased complexity of the tactilefeedback. The interactive wall may be enabled to simulate a scrollwheel, buttons, clicks, swipes, multi-touch gestures, etc.

The systems and implementations of providing infrastructural haptics onwall scale interactive displays discussed above are for illustrationpurposes and do not constitute a limitation on embodiments. A touchdependent tactile feedback wall scale display may be implementedemploying other modules, processes, and configurations using theprinciples discussed herein.

FIG. 5 is an example networked environment, where embodiments may beimplemented. Tactile feedback control may be provided via softwareexecuted over one or more servers 514 or a single serve e.g. web server)516 such as a hosted service. The platform controlling the tactilefeedback may communicate with an interactive wall 511 through network(s)510.

As discussed above, an interactive wall may provide tactile feedbackdepending on detected touch sensory input. Request for a tactilefeedback may be transmitted from the interactive wall 511. Afterreceiving the tactile feedback corresponding to the touch, theinteractive wall may play the tactile feedback in real time. Time framebetween detection of touch and play of the feedback may be under a userperception to detect a delay such as under 0.1 seconds.

Interactive wall 511 may access the control service executed on remoteserver(s) (e.g. one of servers 514) as discussed previously. The servers) may retrieve or store relevant data from/to data store(s) 519directly or through database server 518.

Network(s) 510 may comprise any topology of servers, clients, Internetservice providers, and communication media. A system according toembodiments may have a static or dynamic topology. Network(s) 510 mayinclude secure networks such as an enterprise network, an unsecurenetwork such as a wireless open network, or the Internet. Network(s) 510may also coordinate communication over other networks such as PublicSwitched Telephone Network (PSTN) or cellular networks. Furthermore,network(s) 510 may include short range wireless networks such asBluetooth or similar ones. Network(s) 510 provide communication betweenthe nodes described herein. By way of example, and not limitation,network(s) 510 ay include wireless media such as acoustic, RF, infraredand other wireless media.

Many other configurations of computing devices, applications, datasources, and data distribution systems may be provided forinfrastructural haptics on wall scale interactive displays. Furthermore,the networked environments discussed in FIG. 5 are for illustrationpurposes only. Embodiments are not limited to the example applications,modules, or processes.

FIG. 6 and the associated discussion are intended to provide a brief,general description of a suitable computing environment in whichembodiments may be implemented. With reference to FIG. 6, a blockdiagram of an example computing operating environment for an applicationaccording to embodiments is illustrated, such as computing device 600.In a basic configuration, computing device 600 may include at least oneprocessing unit 602 and system memory 604. Computing device 600 may alsoinclude a plurality of processing units that cooperate in executingprograms. Depending on the exact configuration and type of computingdevice, the system memory 604 may bevolatile (such s RAM), non-volatile(such as ROM, flash memory, etc.) or some combination of the two. Systemmemory 604 typically includes an operating system 605 suitable forcontrolling the operation of the platform, such as the WINDOWS®operating systems from MICROSOFT CORPORATION of Redmond, Wash. Thesystem memory 604 may also include one or more software applicationssuch as program modules 606, sensor module 622, and actuator module 624.

Sensor module 622 may be part of an interactive wall detecting sequence,location, and pressure level on the interactive wall surface. Actuatormodule 624 may play a tactile feedback on the interactive wall. Theinteractive wall may detect touch and play a corresponding tactilefeedback according to the displayed contents. This basic configurationis illustrated in FIG. 6 by those components within dashed line 608.

Computing device 600 may have additional features or functionality. Forexample, the computing device 600 may also include additional datastorage devices (removable and/or non-removable) such as, far example,magnetic disks, optical disks, or tape. Such additional storage isillustrated in FIG. 6 by removable storage 609 and non-removable storage610. Computer readable storage media may include volatile andnonvolatile, removable and non-removable media implemented in any methodor technology for storage of information, such as computer readableinstructions, data structures, program modules, or other data. Computerreadable storage media is anon-transitory computer readable memorydevice. System memory 604, removable storage 609 and non-removablestorage 610 are all examples of computer readable storage media.Computer reach the storage media includes, but is not limited to, RAM,ROM, EEPROM, flash memory or other memory technology, CD-ROM, digitalversatile disks (DVD) or other optical storage, magnetic cassettes,magnetic tape, magnetic disk storage or other magnetic storage devices,or any other medium which can be used to store the desired informationand which can be accessed by computing device 600. Any such computerreadable storage media may be part of computing device 600. Computingdevice 600 may also have input device(s) 612 such as keyboard, mouse,pen, voice input device, touch input device, and comparable inputdevices. Output device(s) 614 such as a display, speakers, printer, andother types of output devices may also be included. These devices arewell known in the art and need not be discussed at length here.

Computing device 600 may also contain communication connections 616 thatallow the device to communicate with other devices 618, such as over awireless network in a distributed computing environment, a satellitelink a cellular link, and comparable mechanisms. Other devices 618 ayinclude computer device(s) that execute communication applications,storage servers, and comparable devices. Communication connection(s) 616is one example of communication media. Communication media can includetherein computer readable instructions, data structures, programmodules, or other data in a modulated data signal, such as a carrierwave or other transport mechanism, and includes any information deliverymedia. The term “modulated data signal” means a signal that has one ormore of its characteristics set or changed in such a manner as to encodeinformation in the signal. By way of example, and not limitation,communication media includes wired media such as a wired network ordirect-wired connection, and wireless media such as acoustic, RF,infrared and other wireless media.

Example embodiments also include methods. These methods can beimplemented in any number of ways, including the structures described inthis document. One such way is by machine operations, of devices of thetype described in this document.

Another optional way is for one or more of the individual operations ofthe methods to be performed in conjunction with one or more humanoperators performing some. These human operators need not be co-locatedwith each other, but each can be only with a machine that performs aportion of the program.

FIG. 7 illustrates a logic flow diagram for a process providinginfrastructural haptics on wall scale interactive displays according toembodiments. Process 700 may be implemented by an interactive wall, orsimilar system enabling haptics on wall scale displays.

Process 700 may begin by detecting a touch on a wall surface throughsensors of an interactive wall at operation 710. At operation 720, oneor more tactile feedbacks corresponding to the detected touch may bedetermined. This may be accomplished, for example, by retrieving thecorresponding tactile feedbacks from a look-up table, employing adatabase query, employing a dynamic algorithm, and comparable methods.At operation 730, the interactive wall may play the tactile feedbackthrough actuators installed on the interactive wall (e.g., array ofactuators installed in an equidistant grid pattern on bars fixed to theinteractive wall studs).

Some embodiments may be implemented in a computing device that includesa communication module, a memory, and a processor, where the processorexecutes a method as described above or comparable ones in conjunctionwith instructions stored in the memory. Other embodiments ma beimplemented as a computer readable storage medium with instructionsstored thereon for executing a method as described above or similarones.

The operations included in process 700 are for illustration purposes.Infrastructural haptics on wall scale interactive displays according toembodiments may be implemented by similar processes with fewer oradditional steps, as well as in different order of operations using theprinciples described herein.

The above specification, examples and data provide a completedescription of the manufacture and use of the composition of theembodiments. Although the subject matter has been described in languagespecific to structural features and/or methodological acts, it is to beunderstood that the subject matter defined in the appended claims is notnecessarily limited to the specific features or acts described above.Rather, the specific features and acts described above are disclosed asexample forms of implementing the claims and embodiments.

1.-20. (canceled)
 21. A method executed by a computing device that provides infrastructural haptics on an interactive wall of an interactive display device, the method comprising: displaying a user interface with touch-based control elements on the interactive wall; detecting a touch on a surface of the interactive wall; reporting the detected touch to a control server; receiving a tactile feedback that corresponds to the touch from the control server; and playing the tactile feedback through actuators integrated to the interactive wall.
 22. The method of claim 21, further comprising: determining the tactile feedback at a processor integrated into the interactive wall.
 23. The method of claim 21, further comprising: determining a sequence of the detected touches that includes at least one from a set of: embedded pressure sensors, optical sensors, and infrared detection based sensors.
 24. The method of claim 21, further comprising: determining the tactile feedback at a remote computing device by a transmission of information associated with the detected touch to the remote computing device.
 25. The method of claim 24, further comprising: receiving information associated with the tactile feedback from the remote computing device.
 26. The method of claim 21, further comprising: employing at least one from a set of: a look-up table, a database query, and a dynamic algorithm to determine the tactile feedback.
 27. The method of claim 21, further comprising: playing back the tactile feedback in real time to detect a delay, wherein the delay is measured from a detection action of the detected touch to a play action of the tactile feedback.
 28. A system to provide infrastructural haptics on an interactive display device, the system comprising: the interactive display device comprising: a communication module configured to communicate with a control server; sensors integrated to a display surface of the interactive display device; and an actuator module configured to play tactile feedbacks through actuators integrated with the interactive display device; and the control server comprising: a memory configured to store instructions; and a processor coupled to the memory, the processor executing an application in conjunction with instructions stored in the memory, wherein the application is configured to: enable display of a user interface with touch-based control elements on the interactive display device; receive information, from the interactive display device, associated with touches detected through the sensors on the display surface of an interactive wall of the interactive display device; and determine tactile feedbacks that correspond to the touches.
 29. The system of claim 28, wherein the application is further configured to: transmit information associated with playing the tactile feedbacks that correspond to the touches to the actuator module of the interactive wall.
 30. The system of claim 29, wherein the interactive wall includes one from a set of an air gap and a dampening agent to enable movement of the interactive display device and avoid vibrational noises from contact between the interactive wall and adjacent non-interactive walls.
 31. The system of claim 28, wherein the application is further configured to: retrieve the tactile feedbacks that match the touches from a data store.
 32. The system of claim 31, wherein the application is further configured to: analyze parameters of the touches, wherein the parameters include at least one from a set of: a location of the touches, a sequence of the touches, and a level of pressure of the touches; and integrate the parameters of the touches with displayed content on the interactive display device.
 33. The system of claim 32, wherein the application is further configured to: transmit the retrieved tactile feedbacks that correspond to the touches of an interactive wall of the interactive display device, wherein the interactive wall plays the retrieved tactile feedbacks through actuators located on the interactive wall.
 34. The system of claim 28, further comprising actuators configured to: move the interactive wall based on detection of at least one from a set of: a swipe motion, a button press, a touch action, a vibration action, and a sound action from the sensors on the display surface.
 35. The system of claim 34, wherein the actuators are vibration generating devices installed on bars spanning across an interactive wall of the interactive display device.
 36. The system of claim 34, wherein the application is further configured to: transmit information associated with playing the tactile feedbacks through actuators integrated to the interactive wall of the interactive wall display, wherein the actuators are installed on studs of the interactive wall of the interactive display device.
 37. A server communicatively coupled to a display device that provides infrastructural haptics, the server comprising: a communication module configured to exchange data with the display device; a memory configured to store instructions; a processor coupled to the memory and a communication device, the processor executing an application in conjunction with instructions stored in the memory, wherein the application is configured to: enable display of a user interface with touch-based control elements on the display device; receive information, from the display device, associated with touches detected on a surface of the display device through sensors of the display device; determine tactile feedbacks that correspond to the touches; and transmit information associated with playing the tactile feedbacks that correspond to the touches to an actuator module integrated with the display device, the actuator module configured to play the tactile feedbacks through actuators integrated with the display device.
 38. The server of claim 37, wherein the application is further configured to: integrate sensory input with displayed content to retrieve a matching tactile feedback.
 39. The server of claim 37, wherein the application is further configured to: determine the tactile feedbacks based on a sequence of the detected touches from at least one from a set of: embedded pressure sensors, optical sensors, and infrared detection based sensors.
 40. The server of claim 37, wherein the application is further configured to: provide a control service as a separate entity accessible through a network. 